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Specification 

[Summary of the Invention] 

The first invention can generate, in an image producing apparatus, an animation in a real time 
fashion by generating synthesized parameters based on externally input parameters and parameters 
stored in main memory and then transforming the input image based on the synthesized parameters. 

Furthermore, the second invention can connect, in the image producing apparatus, playing 
means for outputting the MIDI signal with the image producing apparatus to generate an animation in 
a real time fashion by generating parameters in response to the MIDI signals to transform the input 
image and to emanate the synthesized sound. 

Page 3, lower left column, line 5 to page 7, upper left column, line 7 
[Embodiments] 

Referring now to the attached drawings, an embodiment of the present invention will be 
described hereinafter in detail. 
(Gl) First embodiment 

In FIG. 1, reference numeral 1 generally designates an animation apparatus which produces an 
animation in a real time fashion. 

In the animation apparatus 1, data of the fundamental shape of a character obtained by an image 
pickup means is stored in an input image memory 2. 

As shown in FIGs. 2 and 3, the input image memory 2 stores three fundamental shapes (see 
FIGs. 2A, 2B and 2C) associated with the motion of legs of the character and three fundamental 
shapes (see FIGs. 3 A, 3B and 3C) associated with the motion of arms of the character. 

In response thereto, a parameter memory 4 stores in its memories A, B and C a parameter Q 
associated with the motion of legs, a parameter R associated with the motion of arms, and a parameter 
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S associated with the display position of the character, respectively. 

These parameters Q, R and S are" sequentially allocated to time axes (i.e. expressed in the units 
of hour, minute; second and frame number) and^ stored in the memories A, B and C, respectively, 
thereby the shapes stored in the input image memory 2 can be transformed and synthesized in 
Te»pWns r e^to w tire parameters Q, R and S to display the character in a desirable motion. 

In the memory A in which the parameter Q is stored first, an operator designates desirable 
timing points T3, T8 and Tc and then designates the motion of legs so that the shapes of the legs of 
the character displayed on a monitor 6 become identical with those of legs (FIGs. 2A, 2B and 2C) 
stored in the input image memory 2 at the timing points T3, T8 and Tc. Thus, parameters Q for 
values A3, A8 and Ac are stored in this memory A at timing points T3, T8 and Tc. 

Parameters Q for values al, a2, a4 to a7, a9 to ab, ad, ae, ... are generated from values A3, A8 
and Ac of parameters Q at timing points T3, T8 and Tc by an interpolation operation technique and 
allocated to timing points before and after the timing points T3, T8 and Tc. 

Similarly, in the memory B in which the parameters R are stored, the operator designates 
desirable timing points Tl, T8 and Te and also designates the motion of arms so that the shapes of the 
arms of the character displayed on the monitor 6 become identical with those of the arms (FIGs. 3A, 
3B and 3C) stored in the input image memory 2 at timing points Tl, T8 and Te, resulting in the 
parameters R for values Bl, B8 and Be being stored therein at points Tl, T8 and Te. 

Further, parameters R for values b2 to b7, b9 to bd, ... are generated from values Bl, B8 and Be 
of the parameters R at timing points Tl, T8 and Te by the interpolation operation technique and 
allocated to timing points before and after the timing points Tl, T8 and Te. 

In the memory C in which the parameter S are stored, the operator designates desirable timing 
points T4, T7 and Tc and also designates display positions of characters displayed on the monitor 6 at 
timing points T4, T7 and Tc, whereby the parameters S for values C4, C7 and Cc are stored therein at 
timing points T4, T7 and Tc. 

Furthermore, parameters S for values cl to c3, c5, c6, c8 to cb, cd, ce, ... are generated from 
values C4, C7 and Cc of the parameters S at timing points T4, T7 and Tc by the interpolation 
operation technique and allocated to timing points before and after the timing points T4, T7 and Tc. 

An image converting and processing apparatus 10 is supplied with the parameters Q, R and S 
through weighting circuits 12A, 12B and 12C and adding circuits 14A, 14B and 14C. The 
parameters^;, R and S are supplied thereto in the sequential order in which these parameters are 
allocated to the time axes.. 

Further, the image converting and processing apparatus 10 is supplied with the shape data 
stored in the input image memory 2, and transforms the shapes of respective parts of the character 
expressed with the shape data in response to the values of the parameters Q, R and S. 

More specifically, the image converting and processing apparatus 10 transforms the image, that 
is, transforms the shapes of the legs of the character so that the character may walk and gradually 
transforms the shapes of legs at timing points Tl and T2 until the transformed shape becomes 

identical with the shape (FIG. 2A) stored in the input image memory 2 at timing point T3. 

V. 

Further, the image converting and processing apparatus 10 transforms the shape of the character 
gradually during a period from timing points T3 to T7 and transforms the image so that it may become 
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identical with the shape (see FIG. 2B) stored in the input image memory 2 at timing point T8. 

On the other hand, the shape of the arm of the character is transformed so that the character 
may move the arms. That is, the shape is transformed so that the shape becomes identical with the 
shape (FIG. 3A) stored in the input image memory 2 at timing point Tl, and is gradually changed 
from timing points T2 to T8 so that the shape becomes identical with the shape (FIG. 3B) stored in 
the input image memory 2 at timing point T8. 

The image converting and processing apparatus 10 synthesizes the shapes of the legs and arms 
transformed at timing points Tl, T2, ... so as to form the entire configuration of character, and then 
places the resultantly formed entire shape of the character at a position determined by the parameter 
S. 

An output image memory 16 temporarily stores an image generated by the image converting and 
processing apparatus 10, converts it into a video signal and feeds the signal to the monitor 6. 

Therefore, the monitor 6 can display the animation which changes in the way as is determined 
by the operator. 

A keyboard 20 supplies a sound source 22 with a signal S M (referred to hereinafter as an MIDI 
signal) according to the MIDI standards, whereby a speaker 24 is driven to emanate a synthesized 
sound in response to the key operation of the keyboard 20. 

.A filter 26 is formed of an operation and processing circuit and detects musical scale, stress and 
length of the synthesized sound emanated from the speaker 24 based on the MIDI signal S M , thereby 
to generate three parameters RQ, RR and RS on the basis of the detected results. 

At that time, the filter 26 generates the parameters RQ, RR and RS at cycles coincident with the 
time axes of the parameters Q, R and S, respectively, stored in the memories A, B and C and supplies 
these parameters RQ, RR and RS to weighting circuits 28A, 28B and 28C, respectively. 

Further, at that time, the filter 26 generates the parameters RQ, RR and RS such that the values 
thereof are changed within the ranges corresponding to the parameters Q, R and S. 

Therefore, the weighting circuits 28A, 28B and 28C are respectively supplied with the 
parameters RQ, RR and RS for values A1X, A2X, BIX, B2X, ... and C1X, C2X, ... in response to 
the parameters Q, R and S when the player starts to play the keyboard 20. 

A coefficient control section 30 receives a control signal S C om which is generated from the 
keyboard 20 each time the player plays the keyboard 20, and supplies weighting coefficients Kl, K3, 
K5 and K2, K4, K6 to the weighting circuits 12A, 12B, 12C and 28A, 28B, 28C in response to the 
control signal S C om» respectively. 

The weighting circuits 12A, 12B, 12C and 28 A, 28B, 28C are adapted to weight the parameters 
Q, R, S and RQ, RR, RS in response to those weighting coefficients, respectively. 

The adding circuits 14A, 14B and 14C add weighted results of the weighting circuits 12A, 12B, 
12C and 28A, 28B, 28C and supply the added results to the image converting and processing circuit 
10. 

Thus, when the player plays the keyboard 20, the image converting and processing apparatus 10 
is supplied with a synthesized parameter which results from synthesizing the parameters Q, R, S and 
the parameters RQ, RR, RS instead of the parameters Q, R and S, and transforms the shape of the 
character stored in the input image memory 2 on the basis of the synthesized parameter. 



Therefore, the image converting and processing apparatus 10 can generate the synthesized 
parameter whose value is changed with the weighting coefficient from the coefficient control section 
30 in accordance with the playing of the keyboard 20. Consequently, the animation can be produced 
by transforming the shape of character on the basis of the synthesized parameter, thereby producing 
the animation which is changed in response to the playing of the keyboard 20. 

By switching the weighting coefficients, it is possible to obtain an animation in which the 
motion following the playing of the keyboard 20 is subordinated to the motions pre-determined in the 
memories A, B and C or conversely an animation in which the motions pre-determined in the 
memories A, B and C are subordinated to the motion following the playing of the keyboard 20, 
resulting in the animation being formed in a wide variety of expression styles. 

Further, since the animation apparatus 1 generates the parameters RQ, RR and RS on the basis 
of the MIDI signal S M , the animation apparatus 1 can use a so-called rhythm machine which can 
generate the MIDI signal S M in place of the keyboard 20 or the like, or can produce a synthesized 
sound by further connecting thereto an arithmetic processing unit and thereby produce an animation. 

Therefore, the animation apparatus 1 of this embodiment can be used more conveniently. 

Further, in this embodiment, the synthesized parameters from the adding circuits 14A, 14B and 
14C can be stored in buffer memories 32A, 32B and 32C, and the parameters Q, R and S stored in the 
memories A, B and C can be replaced with the synthesized parameters stored in the buffer memories 
32A, 32B and 32C, if necessary. 

Therefore, the motion of animation is visually confirmed by means of the monitor 6 and, if the 
operator supposes it necessary, the synthesized parameters used to produce that animation can be 
stored in the memories. 

Accordingly, improvised animation can be reproduced by updating the contents of the memories 
A, B and C. 

Further, if the animation apparatus of the present invention is applied to the correcting work of 
animation, then this correcting work can be carried out with ease. 

As described above, according to this embodiment, while the input image memory 2 constructs 
the input image memory in which a plurality of fundamental shapes are stored, the memories A, B and 
C construct main memories in which the parameters Q, R and S used to designate the transformation 
of input images are sequentially stored in a time series fashion. 

Furthermore, the keyboard 20 constructs MIDI signal generating means for outputting MIDI 
signal S M , the filter 26 constructs parameter generating means for generating parameters RQ, RR and 
RS that designate the transformation of input images according to the MIDI signal S M , and parameter 
input means is thus constructed to input parameters RQ, RR and RS with the keyboard 20 and the 
filter 26 in a real time fashion. 

At the same time, the weighting circuits 12A, 12B, 12C, 28A, 28B, 28C and the adding circuits 
14A, 14B, 14C add parameters Q, R and S that are stored in the main memory A, B, C and parameters 
RQ, RR and RS that are inputted through the parameter input means with predetermined ratio and 
construct an adding means for outputting the synthesized parameter. The image converting and 
processing circuit 10 transforms the input image stored in the input image memory 2 according to the 
synthesized parameter and constructs an image processing means for generating the transformed 



image. 

Furthermore, the output image memory 16 forms output image memory for storing the 
transformed image, and the monitor 6 forms display means 6 for displaying the transformed image 
stored in the output image memory 16. The parameter memory 4 transfers the synthesized parameter 
stored in the buffer memory 32A, 32B and 32C to the main memory A, B and C and constructed a 
synthesized parameter transferring means for storing the synthesized parameter in the main memory A, 
B and C as parameters Q, R and S. 

In the configuration as described above, the fundamental shape data of the character initially 
picked-up by the image pickup means is stored in the input image memory 2. 

When the operator designates timing points and the motions of respective parts of the character, 
the parameters R, Q and S presenting the shapes of legs and arms of the character and the display 
position of the character are allocated to the time axes and area stored in the memories A, B and C, 
respectively. 

When the player plays the keyboard 20 after the above preliminary processing, the parameters 
RQ, RR and RS corresponding to the parameters Q, R and S are sequentially generated from the filter 
26 in response to the MIDI signal S M from the keyboard 20 and then respectively weighted by the 
weighting circuits 28A, 28B and 28C in response to the operation of the player. 

Simultaneously, the parameters Q, R and S stored in the memories A, B and C are respectively 
weighted by the weighting circuits 12 A, 12B and 12C, and the weighted results of the weighting 
circuits 12A, 28A; 12B, 28B; and 12C, 28C are added by the adding circuits 14A, 14B and 14C, 
respectively. 

Therefore, the adding circuits 14 A, 14B and 14C can derive the synthesized parameters whose 
values are changed in accordance with the playing of the keyboard 20. Then, the image converting 
and processing apparatus 10 transforms the fundamental shapes of the respective parts of the 
character stored in the input image memory 2 on the basis of the synthesized parameters. 

Transformed shapes of the respective parts of the character are synthesized by the image 
converting and processing apparatus 10, thereby to form the entire shape of the character. Then, the 
entire shape of the character is placed at the display position determined by the parameter S to obtain 
in a real time manner an animation whose motion is changed in response to the operation of the 
keyboard 20. 

The image generated by the image converting and processing apparatus 10 is displayed through 
the output image memory 16 on the monitor 6, and at that time, the synthesized sound generated by 
the sound source 22 is emanated from the speaker 24, and therefore, the animation which is changed 
in accordance with the playing of the keyboard 20 in a real time manner can be displayed on the 
monitor 6. 

At this time, the synthesized parameters are temporarily stored in the buffer memory 32A, 32B 
and 32C respectively and then replaced with parameters Q, R and S stored in the memory A, B and C, 
if necessary. This process allows to reproduce the animation or to simplify correction works on the 
animation. 

According to the above constitution, the synthesized parameters are formed on the basis of the 
parameters Q, R and S set in the memory A, B and C and the parameters RQ, RR and RS formed in 
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response to the operation of keyboard 20, and the input image is transformed on the basis of the 
synthesized parameter, and therefore, the animation which is changed in response to the playing of the 
keyboard 20 in a real time manner can be generated. 

Furthermore, since the parameters RQ, RR and RS are formed on the basis of the MIDI signal 
output from the keyboard 20 at this time, the parameters RQ, RR and RS can be input, as necessary, 
by playing means instead of the keyboard and other input means such as arithmetic processing 
apparatus, and therefore, the animation apparatus of this embodiment can be used more conveniently. 

Page 7, Upper right column, line 8 to end of the page 
[H. Effects of the Invention] 

According to the first invention as described above, since the synthesized parameters are 
formed on the basis of the predetermined parameters and the parameters inputted by means of the 
parameter input means and the input image is transformed in response to the synthesized parameters, 
it is possible to obtain the image producing apparatus that can display animations which present 
desirable changes in a real time fashion by operating the parameter input means. 

Furthermore, according to the second invention, since the synthesized sound is emanated in 
response to the MIDI signal and the input image is transformed on the basis of the parameters 
generated, it is possible to obtain the image producing apparatus that can be connected with the 
desirable playing means outputting the MIDI signal and display an animation in a real time fashion. 
[4. Brief Description of Drawings] 

Fig. 1 is a block diagram, showing the animation apparatus according to one embodiment of the 
present invention, and Fig. 2 and Fig. 3 are schematic diagrams, showing the input images. 
1... animation device, 2... input image memory, 4... parameter memory, 6... monitor, 10... image 
converting and processing apparatus, 12A, 12B, 12C, 28A, 28B, a 28C... weighting circuits, 14A, 14B, 
14C... adding circuits, 16... output image memory, 20... keyboard, 22... sound source, 24... speaker, 
26... filter, 32A, 32B, 32C... buffer memory, A, B, C... memory. 

Fig. 1 
Fig. 2 
Fig. 3 
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